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Abstract of JP625331 B . 
PURPOS&To rationalize various processes, to 
improve the resolution and reduce the color moire, 
and to photograph even a stM frame picture by 
reading necessary Information out of a memory and 
obtaining an image through digital signal 
processing. CONSTiTLTTIONiSlgrials corresponding & 
to color signals Mg, Gv, Cy, and Ye are read out of 
the buffer memory 4 and made into synchronized 
color signals Mg, <av, Cy; and Ye by four 
interpolating filters 6-9. Then those four kind of color 
signals ere Inputted to an RGB conversion part 10 
and converted into primary color signals of R, q, 
and B. In this ease, the four kind of color filters 6-e 
arranged in an Image pickup element are arranged 
in an array of offset sampling structure which Is 
offset by 2Ph vertically, 2Pv horizontally, and Ph 
vertically, thereby reducing color carriers which are 
generated horizontally and vertically. 




> 



GO 
LU 
QD 



Data supplied from the esp®conot database - Worldwide 



Tttp://v3.espaoeneLcom/textdoc?DB=EPODOC&lDX=JP62533 1 8&F=0 2006-06-29 

08/10/2008 THU 17:06 [TX/RX NO 5748] 0007 



Aug-1 0-2006 17:17 From-PHIUPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 008/034 F-919 



wt & m ^) 



^^-253318 



H0 4N 9/07 



ttSEB* mm* F I 

A 9J87-5C 









000001007 










(22)tHBJB 














as m& 








&tm*mETFJl* 3 Ti30# Z^- 



















(B7) [JO*) 

raws] 1 iriBirr s 4 




, I I t ' 




-1- 



08/10/2006 THU 17:06 [TX/RX NO 5748] @ 008 



Aug-1 0-2006 17:17 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 009/034 F-919 



it, 

J&SStfr $ r t X 5 rafcfcft* J: 5 tfc ^ h W» 

a, 6PbPv/| 2Phs i n 
I 2 Ph a i n$+pvc o s G | 

3 £ J: * 5 ii Lfc £ t «r«tft 

^20(^ft<9frlC^LV*SfT4?!l<S>^ h V fi*fg&& 

*6 RG Bffi*fcB^*fr3#ja*a fir^T 6 ^ 
. 5r^» £ i-S 1 £ fc H 2 EBB O* y-fcfcSitE. 

10001} 

#¥**Eff 5*lX *<5 E«*«a**&ffl*fc* ?HWl 

*» 5 * 7-ttUMWcM-*. 
[0002] 

• fcfll«bv «*«0Wtt»»**» S/Nlfc<OR 
[0 0 0 31 Z<Dft*>s «fe**fc*SV>Tfc, 

s/NfcoAS* £ fc X 



-2r 



Pv*Ufci*fc % K»D^> 

+ Pv c o s 8 | SD£2, 4PhPv/ 
(O£0Sk/2) 
[0004] B9*&0J&a»fe*5l;:, £<DtB«a&^ 

^!>v^^<toTV>6. «:da, rHtli^ M g 
lO005iai0», t<D^5{C*7-7-f^-^ 

E4Hfeft«^^<DSfKUB3«t^m (f Hf f v ) ±& 

[oooei zo>m&**bte**w*mi-2r&b u 

[0 0 0 71 ^(Ott*. t^fMfel^^tt, (Mg + 
Cy> i: (VetGr) , (Cy+Gr) t (m 

Q x =Mg+Cy 

C a "Cy+Or 
C 4 =Mg+Ye 



08/10/2006 THU 17:06 [TX/RX NO 5748] @009 



Aug-10-2006 17:17 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 010/034 F-919 



[0008] 

looo 9] 82fc, W»fl^*fflU&*T3J:$tt> 

[00 jo] ±&w*$u£tt*<^itt#fl<D 
Ktt#TI^**fflfcfc*&. 01 2tt* Si l<&*3te 
±fctffr*£**yTo^«^B-efca, ffli 2fc 

«r*UXv>$. fcfc, PbfcSfc**<&*¥#fl<Dtfy 

Pvftafcasrftotry^fc&LTV^. 
[ooai] ES l ottl,lt&m&&&W 

<f„, £ v ) ±iw4»tt5fe^yr^tti:tt«+^ 

t> Bsi 2v*3^xiz&ttto<ottwtii&wmk 
(o r iapv) fcfc**y7*^u-cvN*c*as 

oTV#irttMsl-5. *lt, r©fc*-ry;r*>tfU8K 

wasa co, i/zpv) tet^^yr^i&urv^ 
H l < f « « f v ) = I c A 8 

) I ••.•<!) 

6 (*) <f H , f v ) _hK* 

#*fctti:UT«Llfct>03*Bl 6 (b) X*>*. 01 
& (b> fcftVVC, jft&l 1 4 A % 114b» 116 

^w/v^-i i or*> J*£fc*o**P7H»»f B ~ 



[0 0 1 2] #4fc. 6*TlxO^*»JH-Sfc«>fc 
tFBl 2<OP5®lC*5VNX. *¥#foG>HR# (1/2.P 

h T o) <DWt\z&>**))T&x&.i,x^&zbifi'bi>* 

[00 13] c*MB&qv*T, Si 3~El 6*JSv> 

[0014] ±3fcfl>*5^f M =l/2Ph 

1 / 2 P h 9 ^6&^O^o^«n)-{i<; 3 
[0015] tt±OC^^WffifcLfca*03fe*Wli- 

0T«1 1 1 fcv |filWH^P«^ki-5{fcfB«ll 1 2 

^¥^K^Ph/ / 2^AJWU)t±tRfir22(ck: 

[0016] ^ v 7 4 M—Qi&mm. 

U/2'PHf H ) «coa (icPhf H 

2 P b fc h^^^Ti r btffrt**, 

ww-nom (i)^*^r±Hi5 

f„=l/2Pb©|&8S W^MSklC^VNTraSMT 
Ff4-15db*-C«Pt>5^, f„ *=l/2PhlC^fc 
^•CttMTP»0i:>fc*prv^^ tfes^o-c, 
^3fe*tow— /<*7-f /V^— 1 1 O^V^SSJtEO*^ 



08/10/2006 THU 17:06 [TX/RX NO 5748] Q010 



Aug-1 0-2006 17:17 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 011/034 F-819 



. [ooio] 015 U) ^fc^fe****}*^ 
• i H - 1 / 2 P b #±co/s&^##i^}£#j«d **vr 

[0020] #»KttEU:<0,fc 5 fcWHWA/**** * 
10021] 

1. ePhPv/t 2Pha in« 
|2PhBlnHPvcoaH 

[0024] 

»UT2Ph, *¥^te#i>T2pvxaa*i*ifcP 

R^Wia e> e ft* -*s>*ff*»fc 

* «<o#7— r^/v-*— j^fc^JittJjtf-JEIcfcaj;*^ 
' . . ■frSrafc*** Wlfct? t>to&«r h»* ^v<T<0 



[0022] *^<^o4^*6fciSf*, -fcfcfc 

lt#wibj 0 * & tt^pmis a k e <oAft*art#fl 
*ru ±«aaMfe^o^^otr5/f-*Ph. 

Pvco»6 |SD£2. 4PhPv/ 
[00 27] 

[ssffiGi] sit. *&m<D9mw%ELm\z&^rum 

[0028] aittare-i*>*tt, l^^^M^ ' 
tt*a«is)f&2TCDS ow^m^y 

, AGO (X* 

[0029] A/D5C»$*vvtm*e«> axtft>jv« 2 
[oo3o] tt*fc*Hs»*i-*flrew:, »««?-i<o 



08/10/2006 THU 17:08 [TX/RX NO 5748] @011 



Aug-1 0-2006 17:18 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 012/034 F-919 



tt*tt*fiN 4oroiB7^-8, 7, 8, etc* 
-.A* ^IHJWMt^H^feW^MB. Gr, Cy, Yot 
«tvC, C^€>4«»fe«^ri, RGB&S83 
lOKA*£*u G» BOSWfeflWlBBfcSti, 

[00 3 2] 



(2) 



Gr 

Cy 
YeJ 

Gr. Cy. Yt*>%WWM* U> s Gr 



R 
G 
8 



U) , Cy (X) , Ye (1) £ % MTSCjBtt^ 

10 0 3 41 h^7^f51 RGB 

2&ffil OtCfcOJgjfcSftfcR, G, B030«>B^ 
We*VaR> G v *BfcV>^fc£fc^*::*K*P 

s^MJ**tti 8K,xA*tt5. ^x^hy^^wi 

fr#5 m&V1z3W<M&8&ftY L fc, 2 

(0035] 
I3&2] 



Y 

R-Y 



0.3Q 0.59 
0.70 -0,59 
-0.30 -0.59 



[0 0 3 6) 6£flteR-T, B-Ytt, «t«x.3l$ 

fc$Jvfc&* tM73*va„ Jf Y 

Y=Y H -* (LPF17 > *Y H 

0PP17) tX % P^7^^-17i;Wi:f«S:» 
onw^;^;-^5, (UPP17 ) *Y K f* x u 

7 * /v* - i 7 1 n Mfttiiffifc 

[0038] £«*Sftaa&«r^$aDtt, 

[0 0 3 9] C£T5tt, J*ttO®SMt^Y,. OS/N 

fr*o< *H&Q<gttldWi>Y t WES*** Xfc left* 
[0040) »«^^fr&tf«Wtffi*Y H <0^jfc 

JO 0 4 1] »2r*, tt*Ufc*fc3t»l|el33il,*# 



0.11 
•0.11 
0.89 



R 7 
B* 



(3) 



(0 0 3 7] £©*SflHHftftEll&l 6fc££S*£ht, 
+ 6Y h (0£$Sl) • • • (4) 

J— BBHU Wg, Gr v Cy> Ye*>4£ 

*^Sii*fa^Ph*tt*-?-fcy M-T»A*5fi«rtt 
5jB«53fc<-7*sr Wtt&fc £*BKJ: 

[0 0 4 2) £<D*7^7*/^-35tttt, 

Rd, ^BK *J7^ hWhfti?tf>€ii:, ±|B46 
[004 31 iBJSri, ^W£5lC*9-7^^-SrE 

3fc*iV*-C\ ^l2Mg> Gr, Cy, Y«<0*fe^ 
[0 0 4 4) w<DH»3S^tt*, 01 O^tmi 21C 



08/10/2006 THU 17:06 [TX/RX NO 5748] @ 0 1 2 



Aug-! 0-2006 17:18 



From-PHIUPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 01 3/034 F-919 



mmmn^^ f v = i p vs-e^ar 

& i nmft&Xkto&i-ztotoKttM-^tttti, 
nro4ej *mmwetx* a/de&&s<dW!&\z? 

Mgs Qry Cy. Y e gg<Wfrg#Mt5ttjft 
A= ( BlJ ) = 2, 

Mg (f H . f v > <*w. 

K > * V ) = * Cf tf , fy) ■ ■ < 

ioo4 9] fr&cfi^-x^s m#nm\7 

Ms (f * , £ v > ^Gr Cf H , 

Hi f y )• -V« (f W I *V ^ = * 



• 10 04 8] »X % {2) W^LItK&sZtt^Xs 



3 ! j = 1, 2. 3, 4) • • • (5) 
(f„ , f y ) fc^^T, 



£ v ) =Cy (f M , f v ) =Ve (f 
(6) 



R U H 



Uh; *v) • ■ 
PTriW*, (2) 

f v ) m (**" & 2i — « 22"*" * as**" a 24) * 



(7) 
* (5) 



Cy (f 



<6> fc (7> 3t|i.t 



(8) 



fy> 
fy) 



10 0 6 2] RGBSBftSnOafctttfav 
ffitfeS. ... 



0 0 b a] *», y-f vw»iia2 oiiA ^y-f v« 

J^^VV — 

(0 0 5 4] Rfc, ^»K^?HSfttfKOSR3^ 

-fcUT, ®7 (ft) fcwi-j; 5 ^o^^tj-x 



2. 3) • • . (9) 

10 0 5 5] 07 (a) fc*5V^X, »*»n-^ 7 -f , 
^-5 0|±, * 3 F* , |*J}t^'U-C4 5* O^IrJ^KO. 

ttJB*fte 5 3 * &^SB 3 k 5 VC 

07 (b) £.?M-& 5 KWt&ftXZ X * 



08/10/2006 THU 17:06 [TX/RX NO 5748] @ 013 



Aug-1 0-2006 17:18 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 01 4/034 F-919 



1. 8PhPv/| 2Phs i 
y/ | 2Phs infl+Pveo$ 

a, 

[0 0 6 7] »l<D^IBd 1 jp*** (1 

H 3 ( f a • f v ) = I c O 8 
f H +f v > ) ■ c o s (*/V~2 
1006 91 r^T, W^rlNTSC^T*, «^®B3 

^«>^S6ia*Sto5$^^K:6 4 0. 4 
8 0^^fcfc»*W3VVtf±, fcrZfc^GM&tftf&S 
d % -2/*2/3.Ph, d 3 

[0 0 6 0] £0 (13) 5^fe#Sr»fc-t^TF4«£ 
(*, BJ8 (a) fc^*$ft*?:re«S*ia. 
2H!»ttft¥fl (f„ , f v ) _t»c:fetf*4§tett* B 8 

(b) <D**fc*$*t$. &J8 (b) fc*SV*T* jfcf*5 
4ft, 64b, 65a, 55b, 56ft, 5 6 bj*, # 
¥*tj p ? ^ - 5 0 h ? VTVZ&WM&K 

iooei]*fc, m (ft) *>e>frj&»sj:$fc, «tt 

#ftv\ Ufc*s-pT, ittft * 5 ft^er fZmtfrZ 

xk, (id, (13), U3)3ya 
£xm* (*) frfeH ?lc. MtPli* f„£ 
l/2Pb<0flfc»«tt-C», - 1 5 d b £8itT»1& 

2 p h 4T**fc£fr*#i*5 ^ * tf-e* 5* 

[0 0 6 2]-^ a«iS<fflV^tuXV^> 

Ph»l. 2Pv • • • (14) 

d* =Ph, d 2 = Ph/'2 • » • (16) 

I0063J ±&(OX 1 \z*9mW\ztju3U -Jj-* 

-^7W-5 0^CJ;^ &*TU$:2E#$p 
**-5 oomt^fcic, ^fe^t&^T^ir^hu— 



nHPvcoM |id!^2. 4PhP 

0 I (0SftS*/2) • - ♦ (10) 

ft<fc$. LfctfoT* fe^TW^rKlbL, j6*o2S#ft 
Hfc£fr**afcfclCtt, »lC9K«d, f**«HS (1 
0) O-C&S. 

5 0<D^#{£ (MTPWffi f±> ftO^^i. 

(75 d 8 f B ) • c 0 6 (*/V"2 • d l ( 



(f„ -f v > ) I - 



(11) 



Ph-Pv • • * (1 2) 

«6WTtt, #10l9»d v #J:t*«2<DJE 

= Ph/2 (19) 

«r-r^^ i 5*3 icfe$ 4 £<ofc«>, 

T»T«Bfcft5. 

1 0 0 6 4 ] a*, m 1 ©ss»«mb s astta tz*^ 

[0 0 6 51 J^caffiinj^S, wmntu RGB 

fiHfctesft ^<o«aafiv^^«ffl«ftKyffi^fe 

KlftS<OTv Offit'^'-K^aiTfc^OT, 
[0066] "> 

7±V Y UTftAftSteADiKr J: »ft4-7«y 



08/10/2006 THU 17:06 [TX/RX NO 5748] @014 



Aug-1 0-2006 17:18 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 015/034 F-919 



10 0 &7l Xfc, tf^&n-.**^/^-*, AJtt 
[0 0 6 3] Sfc, fc{ft»**&(&tttrt£oVvC, 49 

[0 0 6 9] ineotes^-r^^c^^ 

[E4] ^WO*?Hftfe^OB2 0^^^ 



[06] *3mv*7~-m&m<o&9<D^m7M- 

ftp -v<* 7 •f/^-owta-efc** 
[iai o] mso*?-i&ti^&m^zmwB&<z>' 

isi si mt<nmto*-*x7jA<?-t>mbim 

[8)14] «6S5«)^*d&o^<^7-fA^— «D4MtBBV 
mi 5] ^o^o^^^^^-o^si-e 

4 *?V7**V 

10. JOa RGB3E&& 
2 0 

5 0 3fc¥»*-/**7,fA**-* 

6 1, 3 2. 5 3 ttJBfire 

54a, 54b, 55a, 55b, 56a, 56b & 



[02] 



[03] 



[09] 



mm 



u3H!3E 
HE3G5E 



I I I I I 



UgO, 



±1; tt 



A 



HEBE 
S3E3CEJ 



Mill 



— 3 



"I ! » ' ' > 



EEJESI 



Mill 



08/10/2006 THU 17:06 [TX/RX NO 5748] @015 



Aug-10-2006 17:18 F rom-PHI L I PS ELECTRONICS ICS 



914-332-0615 



T-315 P. 016/034 F-919 



[01] 



A 

A 
H 



fit 



in 



U. 



M 



rnrn 



4)3$ -t. =s <s k 



] r 



1 I I 



JI 1* I> V ^ if* A K 



tt) (3 | m| 



CCOafitSB 



Eg 



J LJ 



*>J < Q 



CM 



.\ 



08/10/2006 THU 17:08 [TX/RX NO 5748] g|016 



From-PHIL IPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 01 7/034 F-919 



[B!4] 



CO 



«K9 



I© 



K 

A 

A 
H 



IO 



a. 

CL 





> 


< 


A 






cc 




B-Y 




r'l 


CO 
T-J 




o 




1 


ddl 


U. 

5 



I 



« <f0^ a. rv <x K 



cv 



I I 1 



3 



^ V A K 



mm 



CD 



hST— 



I 



^1 



II 

3l 



cfc < Q 



, I 

1 

»- N -PA* 



08/10/2006 THU 17:06 [TX/RX NO 5748] 0017 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 018/034 F-919 



1 

"13 
85 



A 

.> 

H 

z 



a 



i 



IL 



I 



I 



I 



CM 



I I I 



tt| e | 1 m- 



tr a m 



2 



I 



ii 

-■ ^ 



< ^ O 

— T- 



+» A 



8 



-n- 



08/10/200B THU 17:06 [TX/RX NO 5748] @|018 



From-PHILIPS ELECTRON I CS ICS 



914-332-0615 



T-315 P. 01 9/034 F-919 



108) 



to 



■t 



mm 



(A 



A 



H 



ft 



Ed 



U- 

2j 



I 



5 



CD 0>_ 



Si 



I 



40} «{ 



CM 



i r 



# l> V ^ A K 



3ZEI 



C C3 TO 



f 



E S 



is 



< O 

, I 

I ; 

»i f A*. 



s 



gu. 



-12- 



08/10/2006 THU 17:0B [TX/RX NO 5748] @019 



Aug-1 0-2006 17:19 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 020/034 F-919 



lias] 



mi*] 




(b) 




(b) 




tv 

HI 

Us Or 



Ms or 



~7 

t. 



? , 

— -Hh ► 



1/4Pv 



C3C4 



U 

ClCZ 
tt u tt 



C9C4 



CI C* 

t t 

CS C4 

CZ C3 

ft 
I 1 > 

^ U2Ph ^ fW 

CI 04 



1*0 — 



K> IH 



-13- 



08/10/2006 THU 17:06 [TX/RX NO 5748] (g) 020 



Aug-I 0-2006 17:19 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 021/034 F-919 




08/10/2006 THU 17:06 [TX/RX NO 5748] @ 02 1 



Auf-1 0-2006 17:19 



From-PHILIPS ELECTRONICS ICS 



914-332-0615 



T-315 P. 022/034 F-919 




CLAIMS 



[Claim(s)] 

(Claim 1] It has four kinds of color filters, the color filter of the color which is different 
irom each other in a cycle of 2 pixel to a perpendicular direction is repeated, and it 
receives horizontally, and is a period of 2 pixel. And an image sensor with the offset 
sampling structure where the color filter of the color which is offset by only 1 pixel of 
perpendicular directions and is different from each other is repeated, Color image pick-up 
equipment characterized by obtaining an image by having the memory which once 
memorizes the output from the above-mentioned image sensor, reading required 
information from the above-mentioned memory, and performing digital signal 
processing. 

[Claim 2] It has four kinds of color filters, the color filter of the color which is different 
irom each other in a cycle of 2 pixel to a perpendicular direction is repeated, and it 
receives horizontally, and is a period of 2 pixel. And an image sensor with the offset 
sampling structure where the color filter of the color which is offset by only 1 pixel of 
perpendicular directions and is different from each other is repeated, Towards making the 
include angle of theta to a clockwise rotation or a counterclockwise rotation to the 
scanning direction of the above-mentioned image sensor, the beam of light which carried 
out incidence Have the optical member divided into two beams of light which only 
distance D left, and when the pitch of Ph and a perpendicular direction is set to Pv, the 
horizontal pitch of the above-mentioned image sensor Distance D is 
1.6PhPv/|2Phsintheta+Pvcostheta^ (0 <= 

tbeta<=pi/2) 

Color image pick-up equipment characterized by obtaining an image by having the 
optical low pass filter constituted so that the becoming conditions might be fulfilled, and 
the memory which once memorizes the output from the above-mentioned image sensor, 
reading required information from the above-mentioned memory, and performing digital 
signal processing. 

[ Claim 3] In the gain adjustment device which adjusts gain so that the output from the 
Tour above-mentioned kinds of color filters may become fixed to the photographic subject 
of an achromatic color about the output from the above-mentioned image sensor, and all 
lines Color image pick-up equipment according to claim 1 or 2 characterized by having 
ihe signal means forming which forms an RGB code from the output of the four above- 
mentioned kinds of color filters by performing the matrix operation of three-line four 
trains with the sum of the multiplier of two trains of arbitration equal to the sum of the 
two remaining multipliers. 
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DESCRIPTION OF DRAWINGS 



(Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the 1st example of the color image pick-up 
equipment of this invention. 

[Drawing 21 It is drawing showing color filter arrangement of the image sensor which 
constitutes the color image pick-up equipment of this invention. 

I Drawing 31 It is the property Fig. of the color carrier on the spatial-frequency flat surface 
of the image sensor which constitutes the color image pick-up equipment of this 
invention. 

[ Drawing 4] It is the block diagram showing the 2nd example of the color image pick-up 
equipment of this invention. 

I Drawing 51 It is the block diagram showing the 3rd example of the color image pick-up 
equipment of this invention. 

[Drawing 6] It is the block diagram showing other configurations of the 3rd example of 
ihe color image pick-up equipment of this invention. 

I Drawing 71 It is the block diagram of the optical low pass filter which constitutes the 
color image pick-up equipment of the 3rd example. 

I Drawing 81 It is the property Fig. of the optical low pass filter which constitutes the 
color image pick-up equipment of the 3rd example. 

I Drawing 91 It is drawing showing filter arrangement of the image sensor which * 
constitutes conventional color image pick-up equipment. 

| Drawing 10] It is the property Fig. of the color carrier on the spatial-frequency flat 
surface of the image sensor which constitutes conventional color image pick-up 
equipment. 

[Drawing 111 It is drawing showing the sampling structure when carrying om pixel 
mixing read-out about the image sensor of drawing 9 . 

[Drawing 12] It is the property Fig. of the color carrier on the spatial-frequency flat 
surface based on the sampling structure of drawing 11 . 

| Drawing 13] It is the property Fig. showing the passband of the conventional optical low 
pass filter. 

| Drawing 141 It is the block diagram of the conventional optical low pass filter. 
[Drawing IS] It is the property Fig. of the conventional optical low pass filter. 
[Description of Notations] 
I Image Sensor 

3 A/D Converter 

4 Buffer Memory 

10 10a RGB transducer 
20 Gain Equalization Circuit 
50 Optical Low Pass Filter 
51, 52, 53 Birefringent plate 

54a, 54b, 55a, 55b, 56a, 56b Locus of the frequency in which an optical low pass filter 
carries out a trap 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the color image pick-up equipment 
which performs digital signal processing to two-dimensional especially using memory 
about color image pick-up equipment equipped with the solid state image sensor with 
which it comes to arrange two or more photo detectors. 
[0002] 

[Description of the Prior Art] By rapid advance of semiconductor technology in recent 
years, what was made to perform signal processing in digital one is becoming a favorite 
in the field of video signal processing. This is because digital signal processing is 
advantageous in respect of the ease of integration and highly-precise-izing of IC, and 
various adjustments, the goodness of a S/N ratio, etc. compared with analog signal 
processing. 

[0003] For this reason, also in an image sensor, the various methods of digital 
correspondence have been developed from having the advantages, such as small, a light 
weight, and high-reliability. Today most generally the CCD mold image sensor with 
color filter arrangement as shown in drawing 9 is used from viewpoints, such as high 
' resolution, goodness of a S/N ratio, and an ease of signal processing, as an image sensor 
for a video camera or electronic "still" cameras in it. 

[0004] This image sensor has the color filter which repeats the color which receives 
horizontally and is different from each other in a cycle of 2 pixel so that clearly from 
drawing 9 . And the filter array consists of Rhine where Rhine where Magenta Mg and 
Green Gr are repeated, and Cyanogen Cy and Yellow Ye are repeated. Moreover, Mg and 
Gr are an offset sampling array and Cy and Ye have become a square sampling array. In 
addition, contrary to this, Mg and Gr are square sampling arrays and there are some from 
which Cy and Ye are an offset sampling array. 

[0005] Drawing 10 is drawing showing the property of the color carrier on the spatial- 
frequency flat surface (fH and fV) of the image sensor with which the color filter was 
arranged in this way. In drawing 10 , the arrow head expresses the carrier of each color of 
Mg, Gr, Cy, and Ye, and the sense of an arrow head expresses the phase relation of each 
of that color. However, fH A horizontal frequency is shown and it is fV. The vertical 
frequency is shown. 

[0006] As an approach of reading a signal from this image sensor, the approach called 
pixel mixing read-out (or field read-out) is usually used. This is an approach which it 
mixes two lines at a time, and reads the signal charge by which photo electric conversion 
was carried out. According to this approach, a signal charge is read like An-1, An, An+1, 
and ... in A field, as shown in drawing 9 . Moreover, in B field, it is read like Bn-1, Bn, 
Bn+1, and... 

[0007] consequently, (Mg+Cy) from this image sensor and (Ye+Gr) — the pixel signal of 
(Mg+Ye) is outputted by turns with and (Cy+Gr). When the signal now acquired from an 
image sensor for convenience is made to call it CI ~Mg+CyC2 =Ye+GiC3 =Cy+GrC4 
-Mg+Ye, the set of the location of a spatial center of gravity in case these four signals 
are acquired is CI as shown in drawing 1 1 7 C2, C3, and C4. The square sampling 
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structure to depend can be considered. And he is trying to obtain a color picture by 
forming the luminance signal and chrominance signal of each field based on this pixel 
signal. 
[0008] 

[Problem(s) to be Solved by the Invention] However, when performing pixel mixing 
read-out using an image sensor with color filter arrangement as shown in drawing 9 , a 
problem as shown below arises. If it is going to use this image sensor for photography of 
the still picture by an electronic "still" camera etc. the 1st, because of pixel mixing read- 
out, only the image of one of the two's field is obtained, and, for this reason, the so-called 
frame drawing with high resolution cannot be obtained. 

[0009] Although a luminance signal and a chrominance signal will be formed as 
mentioned above from the image sensor by sampling structure as shown in drawing 1 1 
when performing pixel mixing read-out to the 2nd, two line data which for that were 
flown by one line must be used. For this reason, since the information on two points 
which separated spatially will be added, vertical correlation decreases, especially the 
resolution to a perpendicular direction deteriorates. 

[0010] Color moire becomes easy to be conspicuous in order that correlation of the 
perpendicular direction of a chrominance signal may decrease as mentioned above to the 
3rd. This is based on the reason shown below. Drawing 12 is drawing showing the 
property of the color carrier on the spatial-frequency flat surface (fH and fV) of an image 
sensor based on structure like drawing 1 1 . Setting to drawing 12 , an arrow head is CI, 
C2, C3, and C4, The carrier of each color is expressed and the sense of an anrow head 
expresses the phase relation of each of that color. Moreover, the pitch of an image sensor 
with horizontal Ph and Pv express the vertical pitch. 

[001 1] It turns out that the color carrier is generated in the vertical comparatively low 
frequency (0 l/4Pv) in drawing 12 as compared with the property of the color carrier on 
the spatial-frequency flat surface (fH and fV) which showed this to drawing 10 . This is 
equivalent to 240TV books in the video camera of the NTSC standard. And color moire 
will occur on a vertical comparatively low frequency according to an operation of this 
color carrier. Moreover, according to drawing 10 , it turns out that the carrier is generated 
also in the vertical frequency (0 l/2Pv). And according to an operation of this color 
carrier, also when the photographic subject of the pattern that an achromatic color is fine 
is photoed, color moire will occur. 

[0012] Sufficient resolution cannot be obtained from the property of the optical low pass 
filter used for the 4th in order to prevent generating of color moire. That is, in drawing 10 
and both drawings of drawing 12 , it turns out that the color carrier is generated in the 
location of a horizontal frequency (l/2Ph, 0). Although made as [ control / with the 
optical low pass filter generally placed in front of an image sensor ], it is one of these and 
use of this optical low pass filter imitates degradation of horizontal resolution, and this 
color carrier is **. For this reason, in the conventional video camera, the optical low pass 
filter had to be designed by the trade-off with resolution and the color moire which a 
color carrier causes, and image quality had to be determined. 

[0013] This problem is explained to a detail using drawing 13 - drawing IS , According 
to the sampling theorem, the luminance signal should be able to take the passband to the 
frequency of fH =l/2Ph. Therefore, in order not to generate the chip box return distortion 
of a luminance signal, as for an optical low pass filter, what cuts into 0 all of fH*! which 
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is a Nyquist rate / frequency component of 2 or more Phs is ideal. 
[0014] However, since a color carrier is generated in the location of fH =l/2Ph as 
mentioned above, if an optical low pass filter with the above frequency characteristics is 
used, color moire will occur by chip box return distortion of a color-difference signal. For 
this reason, only the part of the band of a color-difference signal is lower than the 
frequency of fH=l/2Ph which carries out a color generation of carriers, and the frequency 
characteristics of an optical low pass filter must set up a passband, as shown in drawing 
13 . 

[0015] The rough configuration of the conventional optical low pass filter on condition of 
the above thing is shown in drawing 14 . In drawing 14 , the optical low pass filter 110 
consists of a birefringent plate 1 1 1 which divides into two the beam of light which 
carried out incidence only of the distance Ph horizontally, a phase plate 112 which makes 
the linearly polarized light the circular polarization of light, and a birefringent plate 113 
which divides into two the beam of light which carried out incidence only of distance Ph / 
2 horizontally. 

[0016] Transfer characteristics of this optical low pass filter (MTF property) Hi =(fH and 
IV) |cos (pi/2, and PhfH) and cos(piPhfH) | ... (1) 
It is expressed with the becoming formula. 

[0017] And it is drawing 15 (a) which expressed this with the graph, and it is drawing 1 5 
(b) which was expressed as a property on a spatial-frequency flat surface (fH and fV). In 
drawing 15 (b), dotted lines 1 14a, 1 14b, 1 15a, and 1 15b are resonance frequency in 
which the optical low pass filter 110 carries out a trap. This shows that the optical low 
pass filter 1 10 carries out the trap of carrier frequency fH =1 of luminance signal/Ph, and 
the carrier frequency fH =l/2Ph of a color-difference signal. 

[0018] Moreover, in the optical low pass filter 1 10 with the above properties, if MTF 
already falls to -15db in about 85% of frequency of carrier frequency fH =l/2Ph of a 
color-difference signal and it results in fH =l/2Ph so that (1) type or drawing 1 5 (a) may 
also show, MTF is 0. Therefore, with the conventional color image pick-up equipment 
using such an optical low pass filter 110, only resolution lower than fH =l/2Ph which is a 
resolution limitation was able to be obtained. 

[0019] Moreover, since fH =1 / frequency component of 2 or more Phs was not fully 
controlled so that clearly from drawing 15 (a), there was also a problem that the color 
moire by the chip box return distortion of a color carrier will occur by this. 
[0020] Its resolution is good while this invention attains rationalization of various 
processings by digital signal processing in view of the above problems, and it aims at 
color moire offering the color image pick-up equipment which can also photo rest frame 
drawing few. 
[0021] 

[Means for Solving the Problem] It has four kinds of color filters, the color filter of the 
color which is different from each other in a cycle of 2 pixel to a perpendicular direction 
is repeated, and the color image pick-up equipment of this invention receives 
horizontally, and is a period of 2 pixel. And an image sensor with the offset sampling 
structure where the color filter of the color which is offset by only 1 pixel of 
peipendicular directions and is different from each other is repeated, It is characterized by 
obtaining an image by having the memory which once memorizes the output from the 
above-mentioned image sensor, reading required information from the above-mentioned 
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memory, and performing digital signal processing, 

[0022] The place by which it is characterized [ of this invention / other ] is the direction 
which makes the include angle of theta for the beam of light which carried out incidence • 
to the above-mentioned image sensor to a clockwise rotation or a counterclockwise 
rotation to the scanning direction of the above-mentioned image sensor. Have the optical 
member divided into two beams of light which only distance D left, and when the pitch 
of Ph and a perpendicular direction is set to Pv, the horizontal pitch of the above- 
mentioned image sensor Distance D 

L6PhPv/|2Phsmtheta+Pvcostheta^ (0 <~ 

theta<=pi / 2) 

Jt is characterized by obtaining an image by having the optical low pass filter constituted 
so that the becoming conditions might be fiilfilled, and the memory which once 
memorizes the output from the above-mentioned image sensor, reading required 
information from the above-mentioned memory, and performing digital signal 
processing. 

[0023] In the gain adjustment device which adjusts gain so that the output from the four 
above-mentioned kinds of color filters may become fixed to the photographic subject of 
an achromatic color about the output from the above-mentioned image sensor the place 
by which it is characterized [ of this invention / of further others ], and all lines By 
performing the matrix operation of three-line four trains with the sum of the multiplier of 
iwo trains of arbitration equal to the sum of the two remaining multipliers, it is 
characterized by having the signal means forming which forms an RGB code from the 
output of the four above-mentioned kinds of color filters. 
[0024] 

[Function] According to this invention constituted as mentioned above, horizontal and the 
color carrier generated perpendicularly decrease by having arranged four kinds of color 
iilters arranged on an image sensor to a perpendicular direction in the array by the offset 
sampling structure where received horizontally 2 Phs and only Ph was perpendicularly 
offset by 2Pv(s). 

[0025] Furthermore, while MTF property sufficient in the field below marginal resolution 
is acquired by having constituted using the optical member divided into two beams of 
light which only the distance D with which certain conditions are filled left towards 
making the include angle of theta for the beam of light which carried out incidence of the 
optical low pass filter to a clockwise rotation or a counterclockwise rotation to the 
scanning direction of an image sensor, the frequency component more than the frequency 
of marginal resolution is controlled enough. 

[0026] Moreover, while adjusting gain about the output from an image sensor so that the 
output from four kinds of color filters may become fixed The color carrier generated 
perpendicularly decreases further by performing the sum of the multiplier of two trains of 
arbitration [ in / for the matrix operation performed in case an RGB code is formed from 
those outputs / all lines ] using the matrix of the three-line four trains made equal to the 
sum of the two remaining multipliers. 
(0027] 

[Example] Hereafter, the example of this invention is explained based on a drawing. 
Drawing 1 is the block diagram showing the 1st example of the color image pick-up 
equipment of this invention. In drawing 1 , 1 is the image sensor which changes into an 
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electric signal the light from the optical low pass filter which is not illustrated, and 
itrranges four kinds of color filters which are mentioned later. 

[0028] An image pick-up signal is read from an image sensor 1 for every pixel. After the 
image pick-up signal read from the image sensor 1 receives processing of CDS (removal 
of the reset noise of the output signal of an image sensor 1, or a clock noise), AGC 
(rationalization of input signal level), etc. in the pretreatment circuit 2, A/D conversion of 
it is carried out by A/D converter 3 to the timing which synchronized with the read-out 
clock. When this A/D convener 3 has a good thing with a linear property and it thinks 
from the point of a quantization error for the color processing performed later, what 
performs A/D conversion in the precision of 8 bits or more is desirable. 
[0029] The signal by which A/D conversion was carried out is once written in buffer 
memory 4 for two-dimensional signal processing performed later. And a signal required 
for processing is read from this buffer memory 4. 

[0030] The signal corresponding to a luminance signal is read from buffer memory 4 one 
by one in the sequence corresponding to the pixel array of an image sensor 1, and is 
inputted into a low pass filter 5. The signal inputted into the low pass filter 5 is the 
luminance signal YH which includes a high-frequency component in response to 
processing predetermined by the gamma transducer 14 and the enhancer 1 5 after a here 
predetermined band limit is made. It is carried out. Thus, luminance signal YH including 
the acquired high-frequency component Low-pass component YL of the brightness 
obtained by approach which is mentioned later It is compounded in the luminance-signal 
formation circuit 16, and is outputted as a luminance signal Y. 

( 0031] On the other hand, the signal corresponding to chrominance signals Mg, Gr, Cy, 
and Ye is read from buffer memory 4 like the above, and is made into the chrominance 
signals Mg, Gr, Cy, and Ye by which synchronization was respectively carried out with 
four interpolation filters 6, 7, 8, and 9. Then, these four sorts of chrominance signals are 
inputted into the RGB transducer 10, and are changed into the three-primary-colors signal 
of R, G, and B. In addition, this conversion is performed by the matrix operation shown 
below. 
[0032] 
[Equation 1] 



R 
G 
B 



A 



Mg 
Gr 

Cy 
Ye 



(2) 



[0033] Here, Matrix A is a matrix of the three-line four trains optimized so that the 
spectral characteristics Mg (lambda), Gr (lambda), Cy (lambda), and Ye (lambda) of Mg, 
Gr, Cy, and Ye of an image sensor 1 might be brought close to the ideal spectral 
characteristics R (lambda), G (lambda), and B (lambda) of R, G, and B to which it was 
set by the NTSC standard. 

[0034] Next, a white balance is taken by changing three signals of R, G, and B which 
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were formed of the RGB transducer 10 into the form alphaR, G, and betaB, in the white 
balance section 1 1, respectively. Then, after gamma conversion of an RGB code is done 
by table conversion by the gamma transducer 12, it is inputted into the color difference 
matrix section 13. Low-pass component YL of the brightness mentioned above by 
performing color difference conversion which suited the NTSC standard as shown below 
in the color difference matrix section 13 Two color-difference-signal R-Y and B-Y are 
generated. 
0035] 



Y 




0.30 


0.59 


0.11 




R y 


R-Y 




0.70 


-0.59 


-0.11 




G v 


B-Y 




-0.30 


-0.59 


0.89 




B'_ 



[0036] Color-difference-signal R-Y and B-Y are outputted after a band limit 
predetermined with the low pass filters 18 and 19 which continue, respectively is made. 
Moreover, low-pass component YL of brightness Luminance signal YH which includes a 
lugh-frequency component as mentioned above after a band limit predetermined with a 
low pass filter 17 is made It is compounded in the luminance-signal formation circuit 16, 
and is outputted as a luminance signal Y. 

[0037] Composition by this luminance-signal formation circuit 16 Y~YH-delta(LPF17) 
*YH+deltaYL (0<=delta<=l) ... (4) 

It comes out and is carried out by the transformation shown. (LPF17) is a low pass filter 
with the same band as a low pass filter 17, and is (LPF17) *YH here. Luminance signal 
YH which includes a high-frequency component for the same band limit as a low pass 
lilter 1 7 It means carrying out by receiving. 

[0038] Generally it is the low-pass component YL of brightness to perform such 
conversion. Luminance signal YH with which a S/N ratio is not necessarily good with 
luminance signal and includes a high-frequency component although it has spectral 
characteristic top right brightness Although a S/N ratio is conversely good, it is because it 
does not necessarily have spectral characteristic top right brightness. 
[0039] delta is the low-pass component YL of brightness here. When a S/N ratio is good, 
you may fix to 1. In this case, the processing in the luminance-signal formation circuit 16 
is the luminance signal YH including a high-frequency component. Low-pass component 
YL of inner brightness It is the low-pass component YL of similar brightness about the 
part of the same band. It is equivalent to replacing, 

[0040] Moreover, luminance signal YH including a high-frequency component delta may 
be fixed to 0 as long as the spectral characteristic is sufficiently close to the property of 
original brightness. In this case, luminance signal YH which does not perform processing 
in the luminance-signal formation circuit 16 at all, but includes a high-frequency 
component It corresponds, when outputting as a luminance signal Y as it is. In addition, 
you may make it change the value of delta in consideration of a S/N ratio, color 
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reproduction nature, etc. according to the brightness of a photographic subject, the 
information on a color, etc. 

[0041] Drawing 2 is drawing showing one example of the color filter arrangement 
iillotted to the image sensor 1 mentioned above. This color filter arrangement consists of 
four colors of Mg, Gr, Cy, and Ye. And the color which is different from each other by 
2Ph(s) to a perpendicular direction is repeated, and it receives horizontally, and is 
considering as arrangement by offset sampling structure which repeats the color to which 
it is 2Pv(s), and only Ph offsets arid is perpendicularly different from each other. 
1 0042] In addition, this color filter arrangement may not necessarily be as this drawing 2 , 
for example, may replace Mg, Cy, or Gr and Ye. Furthermore, you may make it arrange 
with the combination of four colors chosen as arbitration from the inside of not only these 
four colors but the color of Red Rd, blue Bl, White Wh, etc., and the four above- 
mentioned color. 

[0043] Drawing 3 is the frequency-characteristics Fig. showing the property of the color 
carrier on the spatial-frequency flat surface (fH and fV) of the image sensor 1 which has 
arranged the color filter in this way. In drawing 3 , the arrow head expresses the carrier of 
each color of Mg, Gr, Cy, and Ye, and the sense of an arrow head expresses the phase 
relation of each of that color. 

1 0044] As compared with the frequency characteristics in the conventional image sensor 
which showed these frequency characteristics to drawing 1 0 and drawing 12 , it turns out 
in this example that the color carrier is not generated in the vertical location of frequency 
fV =l/4Pv. For this reason, it is hard coming to generate the color moire generated by 
chip box return from these color carriers. Furthennore, fV Since there is no color carrier 
on a shaft, the resolution of a luminance signal can be obtained to fV=l/2Pv which is a 
theoretic resolution limitation. 

[0045] Next, the 2nd example of the color image pick-up equipment of this invention is 
explained based on drawing4 . In drawing 4 , the same sign is given to the component of 
drawing 1 , and the corresponding part, and since these fundamental actuation is the same 
as that of the thing in drawing 1 , detailed explanation is omitted here. 
„ [0046] In this example, the gain equalization circuit 20 is arranged in the preceding 
paragraph of A/D converter 3, and the description is in the place which is adjusting the 
gain of the image pick-up signal acquired by this gain equalization circuit 20 by each 
pixel of Mg, Gr, Cy, and Ye so that it may become homogeneity to the photographic 
subject of an achromatic color. In addition, although this gain adjustment may be 
performed to the analog signal in front of A/D conversion as shown in drawing 4 , in a 
certain case, the quantization precision of A/D converter 3 may carry out after A/D 
conversion enough. 

[0047] It is not only lost that an unnecessary modulation component is overlapped on a 
luminance signal, but by performing such a gain adjustment, it can bring about an 
improvement as shown below also to a chrominance signal. 

[0048] It sets now to the transformation having shown in (2) types, and is Matrix A. A= 
(aij)(i=l,2,3;j-l,2,3,4)...(5) 

It carries out. Since the gain equalization circuit 20 is, on the other hand, adjusting the 
gain of each pixel of Mg, Gr, Cy, and Ye so that it may become homogeneity to the 
photographic subject of an achromatic color, A certain function phi on frequency space 
(fH and fV) is used for the baseband component of Mg, Gr, Cy, and Ye. Mg(fH and fV) 
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-Gr(fH and fV) =Cy(£H and fV) =Ye(fH and fV) =phi (£H and fV) ... (6) 
ft can express. 

1 0049] If sufficient band limit shall be carried out with interpolation filters 6, 7, and 8 and 
the two-dimensional filter of 9 grades, the baseband component of each color here Carrier 
component in the location of the frequency (l/2Ph, 0) in drawing 4 Mg(fH and fV) 
-Gr(fH and fV) =-phi (fH and fV), Cy(fH and fV) =Ye(fH and fV) =phi (fH and fV) ... 

(7) 

[t becomes. 

1 0050] Therefore, the carrier component in this point of an RGB code (2), (5), (6), and (7) 
types R(ffl and fV) =(-al l-al2+al3+al4) phi (£H and fV), G(fH and fV) =(-a21- 
:i22+a23+a24) phi (£H and fV) B(fH and fV) =(-a3 Ua32+a33+a34) phi (fH and fV) 

...<8) 

** ~ it is expressed like. 

[0051] if the sum of the multiplier of the 1 st train and the 2nd train is equal to the sum of 
ihe multiplier of the 3rd train and the 4th train in each line of Matrix A according to this - 
- namely, ail+ai2=ai3+ai4 (2 i= 1, 3) ... (9) 

If the relation to say is realized, the carrier component of the RGB code in this point 
(l/2Ph, 0) will disappear, and the carrier component of the chrominance signal in this 
point will not be generated. 

[0052] That is, since the carrier component of the perpendicular direction of a 
chrominance signal can be extinguished by constituting so that the conditions which 
show the matrix A in RGB transducer 10a in (9) types may be satisfied, it becomes 
possible to reduce the color moire which this generates with the photographic subject of 
ihe pattern that an achromatic color is fine. 

[0053] In addition, when the gain adjustment by the gain equalization circuit 20 can carry 
out correctly with each color temperature, it is not necessary to perform white balance 
adjustment in the white balance section 11. 

[0054] Next, the 3rd example of the color image pick-up equipment of this invention is 
explained. In this example, as shown in drawing 5 , the optical low pass filter 50 of a 
configuration as shown in drawing 7 (a) is used as an optical low pass filter placed in 
front of an image sensor 1. In addition, in drawing 5 , it is the same as that of the 
configuration of the color image pick-up equipment by the 1 st example shown in drawing 
i about other configurations of those other than optical low pass filter 50, Moreover, it is 
good even if the same as that of the configuration of the color image pick-up equipment 
by the 2nd example which showed other configurations of those other than optical low 
pass filter 50 to drawing 4 , as shown in drawing 6 . 

[0055] In drawing 7 (a) the optical low pass filter 50 horizontal — receiving — a 45- 
degree direction « the 1st distance dl only — with the 1st optical member which consists 
of the birefringent plate 5 1 which divides into two the beam of light which carried out 
incidence horizontal — the 2nd distance d2 only - the 2nd optical member which consists 
of the birefringent plate 52 which divides into two the beam of light which carried out 
incidence -- horizontal — receiving — a -45-degree direction — the 1st distance dl only — 
the 3rd optical member which consists of the birefringent plate 53 which divides into two 
the beam of light which carried out incidence constitutes. According to an operation of 
these birefringent plates 51-53, the beam of light which carried out incidence will follow 
a locus as shown in drawing 7 (b). 
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[0056] this optical low pass filter 50 - the 1st distance dl ******** „ i.6PhPv/|2Phsin 
theta+Pvcos theta|<=dl <=2.4PhPv/[2Phsin theta+Pvcos theta| (0 <= theta<=pi / 2) ... (10) 
It constitutes so that the conditions shown by ******** may be satisfied. 
[0057] Namely, the 1st distance dl If the minimum shown to inequality (10) is exceeded, 
the chip box return distortion by the color carrier, especially generating of color moire 
cannot be controlled. When an upper limit is exceeded, it becomes impossible on the 
contrary, to obtain sufficient resolution. Therefore, in order to prevent color moire and to 
obtain sufficient resolution, it is the 1st distance dl. It is necessary to satisfy inequality 

(10) . 

[0058] By the way, the transfer characteristics (MTF property) of this optical low pass 
filter 50 are expressed with the following formula. 

H2 =(fH and fV) |cos (pid2 fH), cos (pi/root2 and dl), and (fH+fV) cos(pi/root2 and dl) | 
(£H-£V).-.(11) 

[0059] Here, with NTSC system, it is the image sensor used when the aspect ratio of the 
display screen is 3:4, and the following relation is horizontally realized mostly in about 
480 image sensor by the number of effective pixels to 640 and a perpendicular direction. 
Ph=Pv...(l2) 

So, at this example, it is the 1st distance dl. And the 2nd distance d2 d2 =Ph [ dl =2 
root2/3, Ph, and ]/2 ...(13) 
It is carrying out. 

| 0060] The MTF property of fulfilling the conditions of this (13) type is expressed with a 
graph as shown in drawing 8 (a). Moreover, the property on a spatial-frequency flat 
surface (fH and fV) is expressed like drawing 8 (b). In drawing 8 (b), dotted lines 54a, 
54b, 55a, 55b, 56a, and 56b are resonance frequency in which the optical low pass filter 
50 carries out a trap. This shows that the optical low pass filter 50 is carrying out the trap 
of all the carrier frequencies of brightness and color difference both signals. 
[0061] Moreover, since resolution threshold frequency fH -1 / frequency component of 2 
or more Phs is enough controlled so that drawing 8 (a) may show, the clinch distortion of 
brightness does not occur. Therefore, thereby, color moire can be reduced. Furthermore, 
since MTF does not fall more than -15db, it can secure resolution to resolution threshold 
frequency fH ^l/ZPh mostly in the frequency domain of fH<=l/2Ph, so that clearly from 

(11) , (12), (13) types, and drawing 8 (a). 

[0062] In the image sensor which is used widely on the other hand now and from which 
the sampling frequency of a luminance signal will be 4 times the carrier frequency fSC of 
a color-difference signal, the following relation is realized mostly. 
Ph=1.2Pv...(14) 

At this time, it is the 1st distance dL And the 2nd distance d2 d2 =Ph [ dl =Ph and ]/2 ... 
(15) 

Then, effectiveness equivalent to above-mentioned effectiveness is acquired. 
[0063] As mentioned above, according to this example, on the other hand, resolution high 
to marginal resolution can be obtained on the property of the optical low pass filter 50, 
find color moire can be enough controlled with the property of the operation by the color 
filter array of an image sensor 1, and the optical low pass filter 50. Therefore, the design 
which it becomes unnecessary to have considered the trade-off with resolution and color 
moire, and gave priority to resolution on the occasion of the design of the optical low 
pass filter 50 can be carried out now. For this reason, since the optical low pass filter 50 
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can be thinly used as a compact, it becomes possible to constitute the whole image pick- 
up optical system in a compact. 

[0064] In addition, in the 1st example - the 3rd example, it is not based on the existence 
of the gain equalization circuit 20, but the luminance signal Y of an output, color- 
difference-signal R-Y, and B-Y may be outputted by non-interlaced one, or you may 
output by interlace. When it outputs by non-interlaced one, it is advantageous to the 
picture compression in a card camera etc., and suitable also for the computer input. 
Moreover, when it outputs by interlace, it can use for a video camera and a still video 
camera. At this time, the D/A converter which changes an output signal into an analog 
signal is needed for an outgoing end. 

[0065] Moreover, each of each processings of above-mentioned interpolation processing, 
a band limit, RGB transform processing, etc. is processings like a line type. For this 
reason, since a result becomes the same even if the sequence of these processings gets 
mixed up, the sequence of each of these processing sections may be put in, changed and 
constituted according to the hardware to be used. Therefore, all the things that become 
the block diagram explained above and equivalence only by changing such sequence are 
contained in this invention. 
[0066] 

[Effect of the Invention] As explained above, the color which is different from each other 
in a cycle of 2 pixel to a perpendicular direction in the color filter array arranged to an 
image sensor according to this invention is repeated, and it receives horizontally, and is a 
period of 2 pixel. And since it considered as the array by offset sampling structure which 
repeats the color which offsets and is perpendicularly different from each other only 1 
pixel The color carrier generated perpendicularly can be lessened and the color moire of 
horizontal, horizontally it is caused by these color carriers, and a perpendicular direction 
can be reduced. Furthermore, since the color carrier generated to a resolution limitation 
can be extinguished, resolution high to a resolution limitation can be obtained. 
[0067] The beam of light which carried out incidence of the optical low pass filter in 
furthermore, the direction which makes the include angle of theta to a clockwise rotation 
or a counterclockwise rotation to the scanning direction of an image sensor Since it 
constituted using the optical member divided into two beams of light which only the 
distance D with which certain conditions are filled left While sufficient MTF property is 
iicquired in the field below a resolution limitation and being able to obtain high resolution 
to marginal resolution, the color moire by the clinch distortion of the color carrier 
generated above the frequency of marginal resolution can be reduced. Therefore, in the 
case of the design of an optical low pass filter, the design which it becomes unnecessary 
10 have considered the trade-off with resolution and color moire, and gave priority to 
resolution can be performed, and the rest frame drawing of high resolution can also be 
photoed. 

[0068] Moreover, while adjusting gain about the output from an image sensor so that the 
output from four kinds of color filters may become fixed Since it was made to perform 
the sum of the multiplier of two trains of arbitration [ in / for the matrix operation 
performed in case an RGB code is formed from those outputs / all lines ] using the matrix 
of the three-line four trains made equal to the sum of the two remaining multipliers The 
color carrier generated perpendicularly decreases further, and thereby, further reduction 
of vertical color moire can be aimed at, and it is effective in the ability to obtain a good 
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image. 

[0069] Moreover, since it was made to perform these processings in digital one there i 
an advantage in respect of the homogeneity of the engine performance, stability, etc. 
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